
N90-12793 

August 15, 1989 


On the Decoder Error Probability of Linear Codes 

K.-M. Cheung 

Communications Systems Research Section 

In this article , by using coding and combinatorial techniques , an approximate 
formula for the weight distribution of decodable words of most linear block codes 
is evaluated. This formula is then used to give an approximate expression for the 
decoder error probability Pe(u) of linear block codes , given that an error pattern 
of weight u has occurred . It is shown that Pe(u) approaches the constant Q as u 
gets large , where Q is the probability that a completely random error pattern will 
cause decoder error. 


I. Introduction 

Coding is used in a digital communication system to 
detect and correct errors introduced in the data stream by 
channel noise. An important parameter to evaluate the 
performance of a code is its decoder error probability. Let 
C be a linear (n,Jfc,(f) code over GF(q ), and C 1 be its 
(n, n — ifc, d x ) dual code. Let t be the number of errors the 
code is designed to correct. Let G be the generator matrix 
of C. Let A u denote the number of codewords of weight it, 
and D u denote the number of decodable words of weight 
u. Decodable words are defined as all words lying within 
distance t from a codeword. If the decoder is assumed to be 
a bounded distance decoder, then the weight distribution 
for the decodable words can be used to find the decoder 
error probability of the code. 

When a codeword c € C is transmitted over a com- 
munication channel, channel noise may corrupt the trans- 


mitted signals. As a result, the receiver gets a corrupted 
version of the transmitted codeword c + e, where e is an 
error pattern of some weight u. If it < f, then a bounded 
distance decoder on the receiver’s end detects and corrects 
the error e, and recovers c. If u > J, the decoder fails, and 
it either 

(1) Detects the presence of the error pattern e, but is 
unable to correct it, or 

(2) Misinterprets the received pattern c+e for some other 
codeword c' if the received pattern falls into the radius 
t of the Hamming sphere around c'. 

Case (2) is, in most cases, more serious than case (1). 
This can occur when an error pattern e is of weight u > 
d — t. As pointed out in [1] and [2], if all error patterns of 
weight u are equally probable, the decoder error probabil- 


ity 


ity given that an error pattern of weight u occurs, denoted 
by Pe(u), is given by the following expression: 

PeW = (>- W (1) 

In this article, by using combinatorial and coding tech* 
niques, an approximate formula for the weight distribution 
of decodable words for most linear block codes is evaluated. 
This formula together with Eq. (1) gives an approximate 
formula for the decoder error probability Pe(u) for most 
linear block codes. It is also shown that 


Pb{u) 


large u 


Q 


where Q is the probability that a completely random error 
pattern will cause decoder error. That is, 


Q ( l ~ QVnft) 


q- r Vn(t) 


( 2 ) 


where r = n — k is the code’s redundancy and V n (t) = 
ELo (?)(^ — 1)* is the volume of a Hamming sphere of 
radius t. 

II. Mathematical Preliminaries 

In this section, combinatorial and coding techniques 
required to derive the results in later sections are intro- 
duced. These techniques are similar to those used in [6] to 
obtain the weight distribution of linear block codes. 


A. Principle of Inclusion and Exclusion 

Let x be a set of N objects, and P(l), P(2), . . . , P(u) 
be a set of u properties. Let N{i \ , * 2 » • • • > *r ) be the number 
of objects with properties P(i\), P(h)i • • • , P(i r )- The 
number of objects jV(0) with none of the properties is given 
by [3]: 

N(9) = N - N(i) + £ N(h , i 3 ) + . . . + (-l) r 

* 1*1 <*3 

X X ^(*1 1 *2 » ■ • • i * r ) • • • 

»1<*2 <*r 

+ (-l) u AT(l,2, 3,. (3) 


There are u + 1 terms on the right-hand side of Eq. (3), 
with the Oth term representing the total number of objects 
in x- If all terms beyond the rth term on the right-hand 
side of Eq. (3) are ignored, then the resulting truncated 
sum is an upper bound when r is even, or a lower bound if 
r is odd. Thus the maximum error magnitude introduced 
in the inclusion and exclusion formula by ignoring all terms 
beyond the rth term does not exceed the magnitude of the 
(r+ l)th term. This fact will be used later to upper bound 
the magnitude of the errors of the approximate weight dis- 
tribution formula. 


B. Facts on Coding Theory 

A linear (n,fc,d) code over GF(q) can be generated 
by a k x n generator matrix G, not necessarily unique and 
such that rank(G) = it. Let / be the maximum number 
such that no / or fewer columns of G add to zero. Then 


/ < k 


( 4 ) 


Equality in Eq. (4) is achieved in the case of maximum 
distance separable (MDS) codes. Since G is the parity- 
check matrix of G 1 , l = d 1 — 1. Let col tl , col, 3 , . . . , col i j 
be any j particular columns of G, j < l < k. It is obvious 
that there exists a k x n generator matrix G' of C and a 
k x k nonsingular matrix K such that 


G' = KG 


( 5 ) 


and coli lt col,* 3 , . . . , col^ of G f form a k x j submatrix 

of the form This fact guarantees that given any 

pattern of j symbols on the i\ th, i* 2 th, . . ., ij th coordinates, 
the number of codewords with the j-symbol pattern on 
the i\th, « 2 th, .. ., ij th coordinates equals q k ~i for j < L 
This fact is important in the next section to evaluate the 
cardinalities of some sets of decodable words. 

III. Derivation of Formulae 

Let D be the set of decodable words of G. Let d be a 
decodable word with Hamming weight u, u > n—l. Let the 
coordinates of dbe indexed by {0, 1, . . . , n— 1}. Then d has 
v zeros (v < /), where v = n - u. Let V be a set of v coor- 
dinates, \V\ = v . Let {i \ , 1 * 2 , • , ij} Q {0, 1, . . . , n— 1} — V 

be a set of j coordinates. Define S(ii,*2i • • • » *j) — {d : 
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d £ D and d. has zeros in V U {»i, *2 , . . - , ij }}. A decod- 
able word d e S(ii, 1 * 2 , •••>*;) always has at least v + j 
zeros. For 0 < j < l — v, the number of zeros in the de- 
codable words of S(i\ , 1 * 2 , • • • » ij) is less than or equal to 
L Now, since all words lying within the Hamming spheres 
(with volume VJi(f)) that surround codewords are decod- 
able words, there are V n (t) disjoint cosets that contain de- 
codable words. Each coset can be constructed by adding a 
coset leader a (Hamming weight of a < <) to each codeword 
in C. Thus from the discussion in Section II. B, for each 
of the V n (t) different coset leaders (each corresponding to 
a coset), there are codewords in C which, when 

added to the coset leader, give decodable words with zeros 
in the v + j coordinates. The number of decodable words 
in S(i \ , * 2 , . . . , ij ) is then given by 

|5(»'i,«2, •••,*>)! = q k - V - j V n (t) 

for 0 < j < l — v (6) 


|S(*i»i 2> • • • > J j)l = Q U ~ J 

for n — v — t -f 1 < j < n — v (8) 


In the cases for 0 < j < / — v } n — v — d + t + 1 < 
j < n — v — t, and n ~ v — t + 1 < j < n — w, the set 
i*l, i 2 , ... , ij can be chosen arbitrarily from a set of u = 
n — v coordinates. Thus for every choice of j , there are 
(p sets S(*i, t 2 , . . . , ij). By the principle of inclusion and 
exclusion, the number of decodable words with exactly v 
zeros in V, which is denoted by D' v , is: 

0V = \sm + (- 1 ) E + • • • + (-!) r 

•1 

X E |5(tl,i 2l ...,»r)| 

t‘l<*3< -<*r 


p or / — v + 1 < j < n-v-d+t , the number of zeros in 
the decodable words of S(ii,i*2> • • • >ij) exceeds /, and ap- 
parently there is no simple expression for |S(*i,i 2 i •••>*;) I- 
For n — v — d + t + 1 < j < n - v - t, the number 
of zeros in a decodable word is greater than or equal to 
n _ d -f t + 1, but less than or equal to n — t. Thus any 
decodable word in S(t’i , i 2> • > ij) has weight less than or 

equal to d — t - 1. It is not hard to see that the elements 
of S(n,i 2 , cannot be decoded into a codeword of 

weight other than Q. Therefore, S(*i,*2» • • • > ij) contains 
all words of weight less than or equal to t in the coordi- 
nates {0, 1, ...n — 1} — (V U {ti,*2> • • • >*;})• Thus, 


+ ... + (— l) n V S(i\ f *2> * • • > in— v) 



n-v-d+t 

E 


j=l-v+l 


(-1 y 


*1<*3< <ij 


n — v — t 

+ e (- 1 y 

j =n-v-d+t+l 



V 

i 



v)i=E(“ j i ) < *- 1) ‘ 

1=0 ^ ' 

ioxn — v — d + t + \<j<n — v — t (7) 


For n-v-t + 1 < j <n-v, since j is greater than or equal 
ton-v-t + l, the number of zeros v -h j is greater than 
or equal to n - t -h 1. Therefore, the number of nonzero 
components is less than t. Thus, all words with zeros on 
KU{n,i 2 ,..., ij } are decodable and thus 


+ E (-tf (“)«“■'■ ( 9 ) 

j=n-v-t + l V - // 

If all the terms beyond the l-v-l terms are ignored in the 
above inclusion and exclusion formula, Eq. (9) is reduced 
to 


jy v = '^(-l + (io) 

j - 0 
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where 


for u > max{n — /, - /) - 1}. 


Ei = (-l ) , - v ( l *^Q k -'Vn(t) 

+ e e 

;=/-v+l *!<...<*> 


and l^i | < (j“ v )g* ^(t) (from the discussion in Section 
II- A). If E 2 = E; U =,-v(-l y(j)9*- v -*Vn(t) is added and 
subtracted from Eq. (10), one has 


D V = ^zr-Vni*) + El + El (11) 


If (,“„)« > G-“+i). th at is - if « > **(« -0-1, £2 is a 

sum of terms with alternate signs and descending magni- 
tude. Then \E 2 \ < (,“J?* _ 'K.(t). Thus 


D ’v = {j -^r-Wt) + E ( 12 ) 


where E — Ei + E 2 and \E\ < 2 (,” v )q k ~ , V„(t). iy v can 
thus be approximated by V n (t), and the goodness 

of approximation depends on how small the ratio R = 
E/[(q— l) u 9 - (” - *lK,(t)] is. By using the upper bound on 
|£|, an upper bound on this ratio is given by 


R< 


(?- i) u 


(13) 


Strictly speaking, the derivation of Eq. (14) is valid 
only for u > max{n — /, ^-(n — /) — 1}. However, it is 
observed that in most cases Eq. (14) is also a close ap- 
proximation to D u for u considerably smaller than n — / 
(as in the case of Reed-Solomon codes). The upper bound 
of R derived above has a denominator term (q — l) u and 
this indicates that this approximation formula is good for 
nonbinary linear codes, and is not useful for binary linear 
codes. The looseness of this approximation for binary lin- 
ear codes is best illustrated by extended binary codes that 
have only even weights. In the case of binary primitive 
codes, Kasami et al. [4] generalized Sidel’nikov’s approach 
[5] and showed that the weights of most binary primitive 
codes have approximate binomial distribution. 

Cheung [6] later showed this is also true for nonbinary 
codes. It is conjectured in this article that the approximate 
Eq. (14) for the weight distribution of decodable words is 
also good for binary primitive codes. For nonbinary linear 

codes, the upper bound on R shows that the approxima- 
tion in Eq. (14) is particularly good for codes with large 
alphabet sets. The upper bound on R for the (31,15,17) 
Reed-Solomon code over GF( 32) is given in Table 1. The 
weight distribution of decodable words and its approxima- 
tion (using Eq. 14) of the (31,15,17) Reed-Solomon code 
are given in Table 2. 

Given the approximate formula of D u , an approxi- 
mate decoder error probability Pe(u) is obtained by sub- 
stituting Eq. (14) into Eq. (1). It is observed that Pe(u) 
approximates the constant Q = q~ r V n (t) as u gets large, 
where Q is the probability that a completely random error 
pattern will cause decoder error. An upper bound of R 
given by Eq. (13) shows that Pe(u) approaches Q “nearly 
exponentially” (for nonbinary codes) as u increases. 


Since v < /, there are (”) = (”) ways to choose v zeros 
from {0,1,.. . ,n — 1}. Then D u can be approximated by 
the following expression: 


D u = E ^v«9- (n - fc) (”)(«- 1)*V«(«) ( 14 ) 

|V|=n— u V 


IV. Conclusion 

In this article, by using the inclusion and exclusion 
principle, an approximate formula for the weight distri- 
bution of decodable words of most linear block codes is 
derived. The decoder error probability Pe(u), which is a 
function of D U1 is then shown to approach the constant 
Q as u gets large, where Q is the probability that a com- 
pletely random error pattern will cause decoder error. 
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